Additional Material

New techniques for dealing with weights are discovered every few years. We've provided the most popular papers in this field over the years.

• Understanding the difficulty of training deep feedforward neural networks
• Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification
• Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift